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Abstract. - We consider the general problem of the first passage distribution of particles 
whose displacements are subject to time delays. We show that this problem gives rise to a 
propagation-dispersion equation which is obtained as the continuous limit of the exact mi- 
croscopic first visit equation. The propagation-dispersion equation should be contrasted with 
the advection-diffusion equation as the roles of space and time are reversed, hence the name 
temporal diffusion, which is a generic behavior encountered in an important class of systems. 



One of the fundamental physical paradigms, applicable to a wide variety of physical pro- 
cesses, is that of spatial diffusion. The text-book example is of a random walker on a one- 
dimensional lattice (see, e.g. pQ). At each tick of the clock, the walker takes a step either 
left or right, the direction chosen randomly with equal probabilities, and one asks what is 
the probability that the walker will be at a given position after a given time. If the walker 
starts at a known point, the answer is a binomial distribution which, in the continuum limit, 
becomes a Gaussian. The variance of the Gaussian grows with time so that, the localization 
of the walker decreases and we say that the walker disperses. If the probability for the walker 
to step in one direction is greater than that for the opposite direction, then the walker prop- 
agates in the direction of higher probability and will eventually visit each site of the lattice 
in that direction. The typical diffusive behavior is then manifested in the continuum limit as 
a Gaussian about a most-likely position which moves at a constant velocity. However, there 
are a number of situations in which it is more natural to ask how long it will take to reach a 
given point - more precisely for a stochastic process, what is the distribution of times taken to 
reach that point. Everyday examples involve processes in which the goal is to arrive at a given 
point as quickly as possible: for example, a marathon (wherein we ask for the distribution of 
finishing times), certain financial instruments, such as stock options (wherein we ask for the 
distributions of times needed for an asset to reach a certain value), traffic- flow (wherein we 
ask for the distribution of arrival times at destination), and packet transport over the inter- 
net. A more technical example, which inspired the present work, is the behavior of certain 
cellular automata which model the motion of a particle on a substrate of scatterers (in 1 or 
2 dimensions) where, for certain types of scatterers, the particle ends up propagating along 
a particular channel OEIEIj and, again, the first-passage time is the physical quantity of in- 
terest. In this letter, we show that this general problem gives rise to a propagation- dispersion 
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equation, much like the biased random walker, with the important difference that the roles of 
space and time are reversed: the distribution of first passage times is Gaussian in the time 
variable with a variance that grows with increasing distance from the origin. In analogy with 
spatial diffusion that occurs in ordinary diffusive phenomena, we call this generic behavior 
temporal diffusion. 

Consider a walker on a one-dimensional lattice and let f(t/St;r/Sr) be the probability 
that it takes t/St time steps to reach the lattice position r/Sr, given that the walker is at the 
origin at time t = 0. Whatever the microscopic dynamics, we assume that we are given, or 
can work out, the set of probabilities {Pj(r)}j^_ 1 that the time between the first visit of the 
lattice site r/Sr and the first visit of the next position, r/Sr + 1, is jSt. Conceptually, these 
represent the probabilities of various waiting times from the first visit of lattice site r/Sr until 
the first visit to r/Sr + 1, i.e. the distribution of single-step waiting times. It is then clear 
that the probability that it takes the walker time t to reach the lattice site r + Sr is equal to 
the probability that it takes time t to reach lattice site r and that the waiting time is zero, 
plus the probability that it takes time t — St and that the waiting time is St, plus ...so that 
the master equation is 

oo 

f(t/St; r/Sr + 1) = ^Pj(r)f{t/St - j; r/Sr) . (1) 

3=0 

Rather than solve this equation directly, we appeal to a more intuitive picture. Let U be 
the time that transpires from the first visit of lattice site / to the first visit of lattice site 
I + 1. The probability distribution for this discrete stochastic variable is precisely the set 
of probabilities {Pj(lSr)}°Z defined above. Next, define Tj+i — Yl\=o ^ which is the total 
time required to reach the lattice site I + 1: the probability that takes on the value t is 
precisely / (t / St; r / Sr + 1) . Since each of the elementary stochastic processes ti is independent, 
the distribution of T; + i in the limit of large I is immediately known, by application of the 
central limit theorem, to be 



«*> T) = Tt^ + = V^F) CXP { Jl ^f) ' (2) 

where the most likely time is 

r/Sr r / Sr oo 

r (r) = £ (?*_ x ) = St ~ 1) Sr) , (3) 

fc=l fe=l j=0 

and the width of the distribution is 



fc=l 



r/5r 



k=l 



J2 Pj ((k - l)Sr)f - *£ Pj ((k - l)Sr)j 
0=0 \j=o 



(4) 



(We note in passing that the exact solution to Eq.QJ is a multinomial distribution, as discussed 
in detail in If the probability distribution of single-step waiting times is independent of 
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position, then r(r) and o~ 2 (r) reduce respectively to 



r(r) 



a 2 (r) 



St^ 



Sr 
(St) 



3=0 
2 



Sr 



E 

3=0 




(5) 
(6) 



which prompts us to define an inverse propagation speed as 

1 t (r) 



St 



3=0 



(7) 



and a temporal dispersion coefficient as 

a 2 (r) 



7 : 



E 

J=0 



3 2 P3 




(sty 

Sr 



(8) 



So the distribution of first-passage times is 

f(t,r) = 



1 



exp 



2^jr 



(9) 



which is in precise analogy to the spatial distribution of a simple, biased random walker: 
the most likely first-visit time grows linearly with increasing distance and the width of the 
distribution grows as the square-root of the distance. 

The distributions given in Eqs.|0) and © are particular solutions for the initial condition 
that the walker is localized at r = and t — 0, or f(t/St;r/Sr = 0) = S(t). To complete 
our description of the first-passage time problem, it is interesting to display the continuum 
equivalent of the first passage equation, Eq.flJ, which would govern the problem for all initial 
conditions. First, we notice that, since the exact first-passage time equation is linear, the 
particular solutions given above are the Green's functions for the general problem. Explicitly, 
if f(t/5t; r/Sr = 0) = fo (t) then the distribution for finite distances must be 



f&r) 



1 



■ exp 



{t-t'-r{r)f 



fo (*') dt' . 



, Y 27R7 2 (r) * V 2a 2 (r) 

from which one finds the equation of motion, the propagation- dispersion equation, 



with 



1 d 

c[r) or 



7 0) = J^ 2 M 



(10) 

(11) 

(12) 
(13) 
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Equation (|llfl can also be derived directly from Eq.Q by means of a multi-scale expansion 
(see 0). 

As a first example, consider a biased random-walker in one dimension. At each tick of the 
clock, the walker moves to the right with probability p and to the left with probability q — 1 —p. 
If the walker is at some particular lattice site, say I, then the probability that it moves to I + 1 
with the next step is p, the probability that it takes three steps to move to I + 1 is p{pq) since 
the probability of moving left, to I — 1, and back is pq and in general, the probability that it 
takes 2m + 1 steps to reach I + 1 is evidently of the form P2m+i = o, m {pq) m p, where a m is a 
combinatorial factor independent of p, since a delay of 2m ticks, starting and ending at lattice 
site Z, requires some combination of m steps to the left and m steps to the right. (Obviously, 
the probability to reach / + 1 in an even number of steps is zero.) If p > q, we expect that the 
walker must eventually reach the next lattice site to the right so that X)m=o am (Pi)" 1 P = !• 
Introducing y = p(l — p), one has p — h (l ± \/l — 4y) with the positive sign appropriate for 
p > 1/2 and the negative sign otherwise; the normalization condition can then be written as 
(forp> 1/2) 



?TI = 



1 



^ amy ' = - (l - \/i - %j , (14) 



and expansion of the right hand side gives a m = 7~^rj7~i ■ Then, having the single-step 



waiting-time probabilities, and noting that 



2m + 1 
^ \ m 

m=0 



p m+1 q m = (p - g)- 1 , (15) 



the first and second moments of the waiting times can be evaluated to give 

1 5t 1 



Sr (p - q) ' 
{St) 2 Apq 
^ (p-q) 3 



(16) 
(17) 



and the distribution of first passage times is given by ©. The continuous limit, in which both 
5r and 5t go to zero, gives finite results for both the propagation speed and the dispersion 
coefficient only if we simultaneously require that p— q go to zero (just as in the usual discussion 
of the spatial-diffusion of the biased random walker pQ). Writing Sr — > eSro, St — > e a Sto and 
p — q — > ke@, we find that 



Stp 
kSro 



a-/3- 



(18) 



{l-k^){St f g 

which are finite provided that a = 2 and (3 = 1. This scaling is identical to that used to 
obtain the spatially-diffusive limit of the biased random walker: the propagation speeds are 
identical, but the dispersion coefficients are quite different, because in spatial diffusion, the 
diffusion coefficient is independent of the scaling of the probabilities (D — > (Sro) 2 /Sto). The 
temporal dispersion coefficient is 7 = D/c 3 , which is also what one obtains by performing a 
change of variables (r — > ct, t — > r/c) in the advection-diffusion equation. 

A more complex example is provided by a walker moving on a lattice with scatterers 
inducing time delays at some (or all) lattice sites, a model which may serve as a paradigm for 
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various processes such as signal propagation in computer networks \7\, traffic flows ,<J, and 
evolutionary dynamics 2 . Of particular interest are models in which the properties of the 
scatterers also change with each scattering process. As a simple example, consider a particle 
moving on a one-dimensional lattice which has scatterers at each lattice site. The scatterers 
can be in one of two states characterized by their "spin" which can take on the values "up" 
and "down" . When a particle moves to a lattice site with spin up, nothing happens to it 
whereas at a spin down site, its velocity is reversed. In both cases, the spin of the lattice site 
is reversed. This model was solved in 0] where it was shown that, for any initial distribution 
of spins (including the random distribution) , the particle always ends up propagating in one 
direction or the other at a constant (average) rate. More surprisingly, the same result is 
obtained on a 2-D triangular lattice with an analogous dynamics (spin up (down) rotates the 
velocity by +(— )2tt/3) |1J and on the square lattice (when all scatterers are initially in the 
same state and rotate the velocity of the particle by ±7r/2 depending on the state). The latter 
model is known in the literature as "Langton's ant" ,2,. As discussed in jS], the distribution 
of first passage times along the direction of propagation in all of these examples can be cast 
in the general form 

oc 

f(t/6t; (r + p) /Sr) = £>/((< - r s ) /St; r/Sr) , (20) 

where p represents the elementary space increment along the propagation strip and Tj = 
(l + aj)bSt (a and b are lattice-dependent integer constants [S]). Equation (|2U|) can be 
mapped onto the form given in Eq.Q) by setting P{\+ a j)b — Pj and all other Pj , s= 0. All 
of these models will therefore, in the limit of large spatial separations, be described by the 
propagation-dispersion equation and the distribution of first passage times will be Gaussian. 

In Fig.l we give an illustration of temporal diffusive behavior in an inhomogeneous system 
where we compare the theoretical large distance solution with simulation data. The time 
delay probability is taken to be f>j=k = p(l — p) k ~ 1 where p is linearly space dependent: 
p = p{r) = p(0) + x T I Sr. The dots are the simulation data obtained by solving numerically 
the microscopic equation l|20|l and the solid line is the solution of the propagation-dispersion 
equation (|11J) . Notice that for space independent probabilities, the width of the Gaussian in 
jni increases like y/r, i.e. in the example given in Fig.l the width at 8000 Sr should be twice 
that at 2000 Sr . Here we observe essentially no change in the respective widths, a consequence 
of the spatial dependence of the waiting time probabilities. 

Recently, Buminovich and Khlabystova [§| have studied models in which the scatterers 
only change state after multiple scattering events. In this case, the distribution of elementary 
waiting times becomes dependent on the lattice position, and the propagation speed and 
dispersion coefficient acquire a spatial dependence. Thus, while the distributions of first 
passage times are still Gaussian, they are not "diffusive" in the usual sense since the inverse 
propagation speed and dispersion coefficient are not constants fEcis. Hllll3|) and reference [B]). 

A more practical example is found in a recent report IIP] which describes an experiment 
where small beads are dropped into a container filled with larger beads. The small beads, 
driven by gravity, percolate through the array of larger beads, and their propagation is care- 
fully measured. Intuitively, one would imagine that the various deflections of the small bead 
as it collides with the larger ones would induce time delays in its downward propagation, in 
which case the distribution of arrival times would be given by Eq. . This is indeed confirmed 
by the experimental results which exhibit the signature of a temporal-dispersion process (see 
Fig. 9 in reference 

In summary, we have demonstrated that the distribution of first- visit times of a particle 
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Fig. 1 - Temporal dispersion curve: f(t,R) at R/8r — 2000 and 8000 (in lattice units). Simulation 
data (dots) are obtained from the first visit equation 1201 with p"j=k = p(l — p) where p = 
p(r) = 0.1 + lQ~ 4 r/8r. The theoretical curve (solid line) is the Gaussian solution of the propagation- 
dispersion equation JTTJ with r(R)/St = i?c _:L (i?)(^) _1 = YZZf P~ X ( r ) = 10989 and 2f977, and 
half-width [2R~/{R)] 1/2 (St)' 1 = [Y^Zi i 1 ~ P( r ))P~ 2 ( r )} 1/2 = 334 and 366, at R/Sr = 2000 and 8000 
respectively. 



propagating with stochastic time delays on a one dimensional lattice, or the one-dimensional 
version of a multidimensional process, satisfies a temporal propagation-dispersion equation 
in the limit of large separations. This generic behavior is analogous to the generic diffusive 
behavior which describes the spatial distribution of the same process as a function of time. For 
a simple biased random walker, the propagation speed is the same in the temporal and spatial 
descriptions, while the temporal- and spatial-dispersion coefficients differ. The temporal- 
dispersion description is relevant to a class of one- and two-dimensional cellular automata 
in which mobile particles and fixed scatterers interact with one another. Experiments in 
granular media also show behavior described by temporal dispersivity. We have restricted our 
discussion to the case where the variance of the elementary time-delay processes exist. There 
is an interesting class of similar processes which are described by power-law distributions, e.g. 
Pj ~ j~^ +v \ in which case, for < v < 1, the distribution appearing in the central limit 
theorem is no longer Gaussian (see, e.g., ). This problem will be treated in a forthcoming 
publication. 
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